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Abstract 

We establish the asymptotic normality of the regression estimator in a fixed- 
design setting when the errors are given by a field of dependent random variables. 
The result applies to martingale-difference or strongly mixing random fields. On 
this basis, a statistical test that can be applied to image analysis is also presented. 
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1 Introduction and notations 

Our aim in this paper is to establish the asymptotic normality of a regression estimator 
in a fixed-design setting when the errors are given by a stationary field of random 
variables which show spatial interaction. Let Z d , d > 1 denote the integer lattice 
points in the <i-dimensional Euclidean space. By a stationary random field we mean 
any family {£k)ke_i d °f real- valued random variables defined on a probability space 
(fi,.F,P) such that for any (k,n) e Z d x N* and any (ii,...,i n ) £ {Z d ) n , the random 
vectors (e^, £j n ) and (e^+fc, £j„+fc) have the same law. The regression model which 
we are interested in is 

Y l = g(i/n)+e l , «6A„ = {1, n} d (1) 

where g is an unknown smooth function and (si) ie %d is a zero mean and square- 
integrable stationary random field. Let K be a probability kernel defined on M. d and 
(h n ) n >i a sequence of positive numbers which converges to zero and which satisfies 
(nh n ) n >i goes to infinity. We estimate the function g by the kernel-type estimator g n 



defined for any x in [0, l] d by 



Y < K 



x — i/n 



9n{x) = — 7 x ■ (2) 

x — i/n 



J2 K 



ieA„ 



K. 



In a previous paper, El Machkouri [9] obtained strong convergence of the estimator 
g n (x) with optimal rate. However, most of existing theoretical nonparametric results 
for dependent random variables pertain to time series (see Bosq |4J) and relatively few 
generalisations to the spatial domain are available. Key references on this topic are 
Biau [2], Carbon et al. [H], Carbon et al. [6], Hallin et al. [II], [12], Tran [25], Tran and 
Yakowitz [26] and Yao [28] who have investigated nonparametric density estimation for 
random fields and Altman p], Biau and Cadre [3], Hallin et al. [13] and Lu and Chen 
[16J, pZZ] who have studied spatial prediction and spatial regression estimation. 
Let \i be the law of the stationary real random field (sk)k& d an d consider the projection 
/ from M. zd to E defined by f(u) = u> and the family of translation operators (T fc ) fceZ d 
from M zd to M zd defined by (T k (u))i = oo i+k for any k G Z d and any u in R z< \ Denote 
by B the Borel a-algebra of M. The random field (f °T k ) keZ d defined on the probability 
space (R zd , B zd , /i) is stationary with the same law as {£k)k& d -, hence, without loss of 
generality, one can suppose that (O, J 7 , P) = (IR Z ,B z ,fi) and = f o T k . An element 
A of T is said to be invariant if T k (A) = A for any k G Z d . We denote by X the a- 
algebra of all measurable invariant sets. On the lattice Z d we define the lexicographic 
order as follows: if i = ...,id) and j = (ji, ...,jd) are distinct elements of Z d , the 
notation i <i ex j means that either i\ < ji or for some p in {2,3, ...,d}, i p < j p and 
i q = j q for 1 < q < p. Let the sets {V k ; i G Z d , k G N*} be defined as follows: 



V i 1 = {jeZ d ;j< Uxc i}, 



and for k > 2 



V i = V i H {j G II 1 ; \i — j\ > k} where \i — j\ — max \%i — ji\. 

l<l<d 

For any subset T of Z d define — cr(si ', i G T) and set 

E w (ei) = E(ei\F v) k\), keV t \ 

i 

Note that Dedecker established the central limit theorem for any stationary square- 
integrable random field (sk)k& d which satisfies the condition 

||£fc^[fc|(eo)||i < oo. (3) 

A real random field (Xk)kez d is sa id to be a martingale-difference random field if for 
any m in Z d , E(X m \a(Xk] k <i ex m)) = a.s. The condition ([3]) is satisfied by 



2 



martingale-difference random fields. Nahapetian and Petrosian [20] defined a large 
class of Gibbs random fields (ik)k& d satisfying the stronger martingale-difference prop- 
erty: E{^ m | cr(£fc ; k ^ m) ) = a.s. for any m in Z d . Moreover, for these models, 
phase transition may occur (see [T8].|19|). 

Given two sub-a-algebras U and V, different measures of their dependence have been 
considered in the literature. We are interested by one of them. The strong mixing (or 
a-mixing) coefficient has been introduced by Rosenblatt [24] and is defined by 

a(U,V) = sup{|P([/nl/) -P(C/)P(V)|, UeU, V e V}. 

Denote by jjr the cardinality of any subset Y of Z d . In the sequel, we shall use the 
following non-uniform mixing coefficients defined for any (k,l,n) in (N* U {oo}) 2 x N 
by 

akA n ) = SU P {0(^,^2), tl r i < k, tjr 2 < /, p(T 1 ,T 2 ) > n}, 

where the distance p is defined by p(Fi,r 2 ) = min{|z — j\, i G Ti, j G T 2 }. We say 
that the random field (sk)k& d is strongly mixing (or a-mixing) if there exists a pair 
(k,l) in (N* U {oo}) 2 such that lim^oo a k ,i{n) = 0. 

The condition ((3l) is satisfied by strongly mixing random fields. For example, one can 
construct stationary Gaussian random fields with a sufficiently large polynomial decay 
of correlation such that ([5]) holds ([8], p. 59, Corollary 2). 

2 Main results 

First, we recall the concept of stability introduced by Renyi [21] . 

Definition. Let (X n )„> be a sequence of real random variables and let X be de- 
fined on some extension of the underlying probability space (O, A, P). Let U be a 
sub-a- algebra of A. Then (X n ) n > is said to converge U -stably to X if for any con- 
tinuous bounded function <p and any bounded and U -measurable variable Z we have 
lim n ^ 00 E(^(X n )Z) =E(tp(X)Z). 

For any B > 0, we denote by C 1 (S) the set of real functions / continuously differen- 
tiable on [0, l] d such that 

sup max I D a (f) (x) | < B, 
xe[o,i] daeM 

where 

Da(f) = dx af f dx a d and M = {a = (a*)* ^ N d ; a = ^ a { < 1 } . 

1 d i—i 

In the sequel we denote ||x|| = vcia^i<k<d \%k\ for any x = (xi, ■■■,Xd) G [0, l] d . We make 
the following assumptions on the regression function g and the probability kernel K: 
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Al) The probability kernel K fulfils J K{u) du = 1 and J K 2 {u) du < oo. K is also 
symmetric, non-negative, supported by [—1, l] d and satisfies a Lipschitz condition 
\K{x) — K{y)\ < r\\x — y\\ for any x,y G [—1, l] d and some r > 0. In addition 
there exists c, C > such that c < < C for any x G [—1, 

A2) There exists B > such that g belongs to C^-B). 

We consider also the notations: 



a 



/ K 2 (u)du and 77 = E?(e £fc|X). 



The following proposition (see |9]) gives the convergence of Eg n (x) to g(x). 
Proposition 1 Assume that the assumption A2) holds then 

sup sup \Eg n (x) - g( x )\ = [h n ] . 
x&[0,i] d geC 1 ^) 

By proposition 3 in [7], we know that under condition ((31), the random variable 77 
belongs to L 1 . Our main result is the following. 

Main theorem. If nh 4 ^ 1 — > 00 and the condition (Ej) no/ck inen for any k <E N* and 

any distinct points x±, ...,Xk in [0, l] d , the sequence 



(nh n ) 



d/2 



( 9n(xi) - Eg n (xi) \ 
\ 9n{xk) - Eg n (x k ) J 



( rW \ 



n— »+oo 



(I -stably) 



\ r« J 



where o 2 = J Rd K 2 (u)du and (rW)i<j<^ ~ A/"(0, 1^) where Ik is the identity matrix. 
Moreover, (T^')i<i<k is independent of rj = J2k&z d E{eo£k\1). 

As a consequence of this theorem, we obtain the following result for strongly mixing 
random fields. 

Corollary. Let us consider the following assumption 



rai >00 Qk\) 

E ' 



Q eo (u) du < 00 



(4) 



where Q eo denotes the cadlag inverse of the function H £o : t — > P(|eo| > t). Then 
implies (Gj) and also the main theorem. 

Remark. If e is (2 + 5)-integrable for some 5 > then the condition 



E 

?7l=l 



d_i .5/(2+5). 



rrr 'a^ ' [m) < 00 



(5) 



is more restrictive than condition (j3J). 



In order to use the main theorem for establishing confidence intervals, one needs to 
estimate 77. It is done by the following result established in [7]. 

Proposition 2 Assume that the condition (Tj| holds. For any N e N* ; set Gn = 

G A n x A„ ; \i — j\ < N}. Let p n be a sequence of positive integers satisfying: 

„3d cV^/i A -<i 2\ 



lim p n = +00 and lim p n E(eq(1 A n e Q ) = 

n— >+oo 



T/ien 



Imax 1, ^ 



77," \ z — ' / n— >+oo 

(i,j)eG Pn 



3 Proofs 

3.1 Proof of the main theorem 

Let x in [0, l] d and n > 1 be fixed. For any 2 in A n , denote 

,'x — i/n\ , , , , aAx) 
aAx) = K — —!— and bAx) 



Denote also 



Without loss of generality, we consider the case k = 2 and we refer to X\ and £2 as x 
and Let Ai and A 2 be two real numbers such that X\ + \% = 1 and let x, y G [0, l] d 
such that x ^ y. One can notice that 

\d/2 ^ 

[Ai(fl- n (x) - Eg n (x)) + X 2 (g n (y) ~ Eg n (y))] = } s i (x,y)e i 

-A 

where Si(x,y) = (A 1 u n (z)6 i (z) + A 2 v n (l/)&i(s/))A 7 - 
Lemma 1 Lei 1,1/6 [0, l] d 6e /jrced. If nh^ 1 — ► 00 t/ien 

i^T^/Tv 2 a *( x ) a ^) = ^ ( 6 ) 



and 



E = 1 ( 7 ) 

where 5 xy equals 1 if x = y and if x ^ y. 



lim 

n-»+oo (n/i r , , 

V y «SA r , 
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Proof of LemrnaUl In the sequel, we denote ip(u) = j^K (j^j K \ \^-J and I n (x, y) 
I[o i] d we nave 



I n (x, y) = ^2 du=^n d 4>( 

ieA n jR i/n ieA n 



where Ri/ n — l)/n, zi/n] x ...x](i^ — l)/n,i d /n] and A is the Lebesgue measure 
on M. d . Let <f x (u) — (x — u)/h n , for any v in [0, l] d , we have 

dK 



d(K o ip x )(u)(v) = j^^Vi^-^((p x (u)). 

11 i=l j=l 1 

Using the assumptions on the kernel K and noting that 



= — 



d(K o <p x )(u) x K(<f y (u)) + d(K o <p y )(u) x K((p x (u)) 



we derive that there exists c > such that sup u6 r 0jl ]d < chn^ 1 ^. So, it follows 

that 



(nh n 



^ ai{x)ai(y) - I n (x,y) = n d (4>(i/n) - ip(a)) 



< sup ||#(u)|| y2n' d \\i/ 

C 



n — Ci 



i 



-> 0. 



Moreover, 



I n (x,y) 



K{u)K [u + 



y-x 

hn 



du. 



'<M[o,i] d ) 

So, we obtain lim„^ +00 I n (x, y) = 5 xy a 2 and consequently ([6|) holds. The proof of ([7]) 
follows the same lines. The proof of Lemma [His complete. □ 

Using Lemma[T]and denoting k xv = (Ai + A 2 ) 2 5xj/ + 1 — S xy , we derive 



lim V s- (x, y) = k 2 = 1 (since x ^ y). 



ieA„ 



So, denoting 



Si(x,y) 



E^aJ^v) 



it suffices to prove the convergence X-stably of ^ ieA Si(x, y) E{ to y/rjr where r ~ 
J\f(0, 2). In fact, we are going to adapt the proof of the central limit theorem by 
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Dedecker [7]. For any i in Z d , let us define the tail a-algebra J^-oo = n^^J^yk 
(we are going to note J-"-oo in place of .Fo,-oo) and consider the following proposition 
established in [7]. 

Proposition The a-algebra X is included in the ^-completion of F-oo- 

Let / be a one to one map from [1, N] fl N* to a finite subset of Z d and (£i)i e ^ d a real 
random field. For all integers k in [l,iV] 3 we denote 

k N 
i=l i=fc 

with the convention S/(o)(6) = «S/(jv+i) (£) = 0. To describe the set A n = {l,...,n} d , 
we define the one to one map f n from [1, n d ] fl N* to A n by: f n is the unique func- 
tion such that for 1 < k < I < n d , f(k) < iex f(l). From now on, we consider two 
independent fields (r^ ■ )» 6 z d an d (^i )iez d °f i-i-d- random variables independent of 
( £ i)»ez d an d I such that 7q and r^p have the standard normal law A/(0, 1). We 
introduce the two sequences of fields Aj = Si(x,y)ei and 7« = Si(x,y)riy/rj where 

n = + rf ) ~ A/(0, 2). Let h be any function from E to JR. For < k < I < n d + 1, 
we introduce h k [(X) = h(Sf( k )(X) + SjnJj)). With the above convention we have 
that h k>n d +1 (X) = h(Sf(k)(X)) and also h j(X) = h(SjnJ'j)). In the sequel, we will 
often write h k j instead of h k j(X) and Sj instead of Si(x,y). We denote by Bf(M) the 
unit ball of C^(M): h belongs to Bf (R) if and only if it belongs to C 4 (M) and satisfies 
max <K4 ||^ W ||oo < 1- 

3.1.1 Lindeberg's decomposition 

Let Z be a X-measurable random variable bounded by 1. It suffices to prove that 
for all h in Bf(R), 

\\m^E{Zh(S f{nd) (X))) = E [Zh ((A!T (1) + A 2 r (2) )V^ 

We use Lindeberg's decomposition: 

n d 

h(S f(nd) (X)) - h ((A x rW + A 2 r (2) )v^)]) = E (Z[h k<k+1 - h k ^ k \) . 

k=l 



E[Z 

Now, 



h k) k+i — h k _i^ k — h k ^ k+ i — h k _i )k+ i + h k _i^ k+ i — h k _i^ k . 
Applying Taylor's formula we get that: 

hk,k+i - ^&-i,fe+i = Xf( k )h k _ 1>k+1 + -Xf^h k _ ltk+1 + R k 
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and 

, , , / 1 2 l" 

ll k -l,k+l - hk-l,k = -7/(fc)%-l,fc+l - 2^( fc ) h k-l,k+l + r k 



where \R k \ < X 2 f{k) (l A \X f(k) \) and \r k \ < 7/( fe )(l A |7/(*)D- Since ( x ,n)i^f(k) is 
independent of r/(fc), it follows that 

E \Z'r m h' k _ ltk+1 J =0 and E (^7/(fc)^fc-i,fc+i) = E (^/(fc^fc-i.k+i) 
Hence, we obtain 



7t 

M5 n (X)) - h ((A!r w + A 2 r (2) )^)]) = 

fe=i 

fc=i v 



k=l 

.d 



Arguing as in Rio [2 3 J , it is proved that lim n ^ +00 Ylk=i E (1-^*1 + l r &l) = 0. Let 
us denote Cat = [— N, N] d R Z d for any positive integer iV. If we define ^ = 
SfceCjv.! ^ ( £ o^fc|2^), the upper bound E\t]—T] N \ < 2 J2kev N E\E ( £ o^k\1) | holds. Hence 
according to condition ([3]) and the above proposition, we derive limjv-»+oo E\r]— t)n\ = 
and consequently we have only to show 

atS^oo^+S 5 ^ ^E(ZX m h' k _ 1)k+1 ) +e[z (Xj {k) - s 2 fik) r] N ) t±h±l j j = q. 

(8) 

First reduction 

First, we focus on 5^/&=i E (ZXf^ k )h' k _i k+1 ) . For all X in N* and all integer k in 
[1, n d ], we define 

E? = /([l, fc] n N*) n and ^ fc) (X) = £ X,. 

For any function * from R to R, we define = V(Sf (k) (X) + S c f{l) (^)) (we shall 

apply this notation to the successive derivatives of the function h). Our aim is to show 
that 



71 

lim limsup^E [Z [X f(k) h' k _ 1>k+1 - X m (S f{k -i)(X) - Sf {k) (X)) h' k _ lk+l )) = 0. 

(9) 



N 

" k=l 
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First, we use the decomposition 

Xf(k)h k _ ljk+1 = X f ( k )h k N _ ltk+1 + X f{k ) (h k _ lk+1 - h£_ 1)k+J ) . 

We consider a one to one mapm from [1, |E^|]nN* to E k and such that \m(i)—f(k)\ < 
\m(i—l)—f(k)\. This choice of m ensures that S m a) (X) and S m a-i)(X) are ^Amw-fw]- 

V f(k) 

measurable. The fact that 7 is independent of X together with proposition 3 in [7] 
imply that 

E (zX m ti (%. +1) (7))) = E (ti (% +1) (7))) E (ZE {X fW \^)) = 0. 
Therefore \E (ZXf( k )ti k N _ 1 k+1 ) | equals 

H / r i\ 

Y,E[ZX m / i '(5 m(i) (X) + ^ (fc+1) (7))-/ i '(5 m(i _ 1) (X) + ^ (fc+1) (7)) 
Since S m u\{X) and S m u-u(X) are J~ v \ m (i)-f(k)\ -measurable, we can take the conditional 



/CO 



expectation of Xf( k ) with respect to -Tyimco-zwi in the right hand side of the above 



f(k) 



equation. On the other hand the function ti is 1-Lipschitz, hence 

\ti {S m(t) (X) + S c f(k+1) (j)) - ti (S m{i -i)P0 + ^ (fc+1) (7)) I < 1^)1- 
Consequently, the term 



E ZX 



is bounded by 
and 



ti (S m(l) (X) + % +1) ( 7 )) - ti (S m ^ 1} (X) + S} {k+1) ( 7 )) 
E\X m{i) E\ m{i) _ f{k) \ (X f(k) ) I 
£ \ ZX f{k) h k _ l k+1 j I < ^S|X m (i)S| m (i)_/(fc)|(X/( fc ))|. 



Hence, 



k=i 



/^2 E [ ZX f(k)h£L lik+1 ) < ^ l S m(i)|^|£m(i)^|m(i)-/(fc)|(£/(fe))| 



k=l 



i=l 



< a ^ ii^-^i^o)!!! < +00 (Ag 



where (by Lemma [T]) we used the fact that 



sup I Si I — O 

ieA n 



{nh n )*/ 2 



(10) 



and 

N = O {{nh n ) d l 2 ) . (11) 

ieA n 

Since ((3D is satisfied, this last term is as small as we wish by choosing N large enough. 
Applying again Taylor's formula, it remains to consider 

Xf(k)(h k -i,k+i ~ h k-i,k+i) — Xf(k){Sf(k-i){X) - Sj{k){X))h k _i tk+1 + R k , 

where \R k \ < 2\X m (S f{k ^(X) - S» k) (X)){l A \S f(k ^(X) - Sf {k) (X)\)\. It follows 
that 

j2 E \ R 'k\ < 2AE (Vol (j2 n) ( 1A J2 nn)) ( A G R +)- 

fe=l V VieAjv / V ieA^ / / 

Keeping in mind that Sj — ► as n — > oo and applying the dominated convergence 
theorem, this last term converges to zero as n tends to infinity and ([9]) follows. 

TTie second order terms 

It remains to control 

w 1 = b( z£C w { % + X /w (S /(t _ 1)( X) - S^ )( .Y)) - %^ 



fc=i 



(12) 



We consider the following sets: 

A» = {iEA n ;d(i,dA n )>N} and 1% = {1 < i < n d ; /(z) G A^}, 



and the function \I/ from M zd to M such that 

*(e) = el + 2e ° £i - 

For k in [l,n d ], we set Dj* = r] N - * o T f( - k \e). By definition of * and of the set I*, 
we have for any k in 

* o r'«(e) = e 2 m + 2e m (S f[k „ 1} (e) - Sf {k) (e)). 

Therefore for k in J„ 

s ){k) D k = s }(k)VN - Xf (k) - 2X /(A .)(S' / ( fc _i)(X) - Sf (k) (X)). 

Since lim n ^ +oa n~ d \I^\ = 1, it remains to prove that 

/ n d \ 
AT^oo^^P^ ( Z EW-Wl I? f ) = 0. (13) 



k=l 
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3.1.4 Conditional expectation with respect to the tail a -algebra 

Now, we are going to replace D k by E {Pk\Tf{k),-oo)- We introduce the expression 

n d 

k=l 

For sake of brevity, we have written h' k _ lk+1 instead of h" k _ l k+l {X). Using the station- 
arity of the field we get that 

n d 

k=i 

For any positive integer p, we decompose in two parts 

n d n d 
k=l k=l 

where 

JI(P) = E {s) (k) Z{hl^ k+1 oT-^{e) - l-F-oc)]) 
and J|(p) equals to 

E (s 2 m Z[h' k _ hk+1 oT-^ - h k \ k+l oT-^]{X)^{e) - E(Hf(e)\^)]) . 

From the definition of fc+1 , we infer that the variable h k _ x k+1 o T~^ k \X) is T v v- 
measurable. Therefore, we can take the conditional expectation of ty(e) — E(^(e)\J-'- 00 ) 
with respect to Tyv in the expression of J k {p). Now, the backward martingale limit 
theorem implies that 



lim E\E(V(e)\F V p) - E(^(e)\F_ 

p^+oo 



and consequently 



On the other hand 



lim lim sup 



k=l 



0. 



fe=i 
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Hence, applying the dominated convergence theorem, we conclude that H% tends to 
zero as n tends to infinity. It remains to consider 

(n d 
Z h k-l,k+l s2 f(k) E ( D k\Ff(k) -oo) 
fe=l 

3.1.5 Truncation 

For any integer k in [1, n d ] and any M in R + we introduce the two sets 

B k( M ) = E ( D k\^ f(k) -oo) i|r, J v-£(*oT/( fe )( £ )|^ /(fe)i _ 00 )|<M 



and 



< (M) = l^-oo) - B^(M). 



The stationarity of the field ensures that E\B k (M)| = (M)| for any /c in [l,n d ]. 

Now, applying the dominated convergence theorem, we have lim M ^ +0O E\B\ (M)| = 0. 
It follows that 

J i ^ 00 T, E (C W 4(X ( M )) = °- 

Therefore instead of it remains to consider 



W 3 = E\zJ2hU, k+1 s 2 m B£(M) 



k=l 

3.1.6 An ergodic lemma 

The next result is the central point of the proof. 
Lemma 2 For all M in M + , we introduce 

(3 N (M) = E ([ VN - E (^(e)!^)] t\ m - E ^)\^)\<M\ X ) ■ 

Then 



lim j3 N (M) = a.s. and lim i£ 

M— >+oo n^+oo 



^(M)-^4 (fc) 5f(M) 



fc=i 



0. 



Proof of Lemma [E Let 

"(e) = [vn-E JLqo)] l| w -B(*( e )|^_«,)|<M- 

Using the function it, we write /3jv(M) = £J(u(e)|X). The fact that /3jv(M) tends to 
zero as M tends to infinity follows from the dominated convergence theorem. In fact 
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lim.j^-,.00 u { £ ) — — Ei^ie^F^oo) and u(e) is bounded by \r] N — E(^f(e)\J r - 00 )\ which 
belongs to L 1 . This implies that 

lim (3 N {M) = E (t]n — (e)^) \X) a.s. 

Since X is included in the P-completion of F-oo (see the above proposition) and keeping 
in mind that r] N is X-measurable, it follows that 

lim /3 N (M) =tin- E($(e)\l) a.s. 

M—*oo 

By stationarity of the random field, we know that E(eoEk\I) = E(eoe-k\T) which 
implies that E(^(e)\X) = r/jv and the result follows. 

We are going to prove the second point of LemmaO Noting that B k (M) = uoT^ k \e), 
we have 

n d 

k=l ieA„ 

Finally, the proof of lemma [2] is completed by the following lemma which the proof is 
left to the reader. 



Lemma 3 



lim 

n— >oo 



"£s 2 l uoT{e)-E{u{e)\l) 



As a direct application of lemma O we see that 

(n d \ 

is as small as we wish by choosing M large enough. So instead of W$ we consider 
Wt = E\ Z^2hl_ 1M1 s 2 m [B»(M) - (3 N (M)] 

y k=i 

3.1.7 Abel transformation 

In order to control W4, we use the Abel transformation: 

n d / k 



W 4 = E 



E E s "d B i ( M ) - z(h'i M - h 

<- k = l \i = l J 

I n d 

+ E Zhl d>nd+2 s 2 m [B?(M) - (3 N {M)} 



k,k+2) 



k=l 
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Now 



E Zh 'n^ + 2 E s miB%(M) - (3 N (M)] < E (3 N (M) - £ s} {k) B»(M) 



k=l 



k=l 



Then applying lemma [21 we obtain 



lim 

n— >+oo 



fc=l 



Therefore it remains to prove that for any positive integer N and any positive real M, 



lim i£ 

n— >+oo 



fc+1 ^k,k+2 



fc=l \i=l 

Zas£ reductions 



We are going to finish the proof. We use the same decomposition as before: 



h 



k,k+2 



-.11 -.11 ..a -.it -.a 

"-fe-l.jfc+l = < l k,k+2 ~~ fyfe.fc+l + ^k.k+l ~ "'k-l.k+l- 



Applying Taylor's formula, we have h kk+2 — 

K,k+i = -lf(k+i)K,k+2 + tk and h k>k+1 - 
K-i,k+i = X m ti k _ hk+1 + T k where \t k \ < l) {k+l) and \T k \ < X 2 f{k) . To examine the 



remainder terms, we consider: 



E E4w E4«[ s f w - mm)] z £ 



fc=i 



,i=i 



The definition of Bf(M) and of (3n(M) enables us to write for all integer k in [1, n a 



J2s 2 m\B?(M)-p N (M)\<2M. 



i=l 



Therefore 

- d ' k 



E 



E \J2 s ml B ?( M ) -MM)} s 2 m Ze 2 f{k) t l£nk)l>K 



k=i \i=i 



<2ME {e 2 t l£ol>K ) 



and applying the dominated convergence theorem this last term is as small as we wish 
by choosing K large enough. Now, for all K in M + , Lemma [2] ensures that 



n l™ E XX/W E4(^( M ) "MM)] ZeJ w l, £/(fc)| <* = 0. 



k=l 



J=l 
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So, we have proved that 

(n d / k 
E E4«[^W-MM)])ZT fc ) =0. 
fc=l \i=l 

In the same way, we obtain that 

(n d / k 
E E 4©^^) - ) ^ ) = o. 
k=i \i=i ) i 

Moreover since (e, (?"<&) #/(fc+i)) is independent of T/(fc+i) we have 
£ f E s /»[ S f ( M ) - MM)hf(.k+i)Zh" k 



L k,k+2 



0. 



,4=1 

Finally, it remains to consider 

- d / k 



W* = E 



E E s :W s f « -Mm %Cw 



fe=i \i=i 



Let p be a fixed positive integer. Since ft,' is 1-Lipschitz, we have the upper bound 
lfyfe-i,fc+i ~~ ^fc I — I'S'/tjfc— _ S/rjfc) (-^") I ■ Now, we can apply the same trunca- 
tion argument as before: first we choose the level of our truncation by applying the 
dominated convergence theorem and then we use Lemma El So, it follows that 



lim E 

n— >+oo 



E E 4(0 WW - Mm)] zx m (h'l hk+1 - C\ 



k+lj 



k=l \i=l 

Therefore, to prove our theorem it is enough to show that 

,d / k 



lim lim sup E 



E E4«W( M ) -Mm zx m h k \ 



k+l 



k=l \i=l 



0. (14) 



We consider a one to one map m from [1, \E k \] flN* to E v k and such that \m{i) — f(k)\ < 
\m(i — 1) — f(k)\. Now, we use the same argument as before: 



h k \ k+1 - h M (S° m {>y)) = J2h'"(S m(l) (X) + Sj w (i)) - h'" (S^iX) + ^ (fe) ( 7 )) 



i=i 

<Ei^. 

4=1 



m(4) | 
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Here recall that B^(M) is .^-measurable and /3jv(M) is X-measurable. We have 
£(£/( fe ) |Z) = 0, E(ef(k)\J 7 f(j e ^ 00 ) = and #(£/(&) | J 7 /® -oo) = for any positive integer 
% such that i < k. Consequently, for any positive integer i such that i < k, we have 



E (s 2 m [B»(M) - (3 N (M)]Zs m e m h' (Sfofr))) = 0. 
Therefore using the conditional expectation, we find 



i d / k 

E 

k=l \i=l 



E E 4« - ^( M )] 



fc+i 



< 2M y]|a/( fc )| |s mW | J B|£: m (i) J B| mW _ / ( fc )|(£: / ( fc ))| 



fe=i i=i 



fc=i iev p 

<2^4M^ J B|£ i E| i |(£ )| (AeR+) by (TT0|) and (PTTj). 

Since ((HI) is realised the last term is as small as we wish by choosing p large enough, 
hence W4 is handled. Finally, the main theorem is proved. □ 

3.2 Proof of the corollary 

As observed in [7], the proof of the corollary is a direct consequence of Theorem 1.1 in 
Rio |22j. In fact, for any k in Vq, we have 

rai.oc(\k\) 

E\e k E ]kl (e )\ <4 / Q 2 £Q (u) du. 

Jo 

The proof of the corollary is complete. □ 



4 Application 

The direct consequence of our result is that it allows the construction of statistical 
tests able to quantify the estimation error. For this purpose, we show the construction 
of such a test that can be used in image denoising pill, US, [27] . I n the context given by 
the model (CTJ) , let us consider the following situation : a true image g is affected by a 
correlated additive noise e, that gives Y for the observed image. 

For the original function two images were considered. The first one is a simulated 
image, a two-dimensional sinusoide, whereas the second one is the very well known Lena 
image. The first image since it represents a continuous function, perfectly matches the 



16 



hypothesis of our results. The second one represents a piece-wise continuous function, 
so the hypothesis of our result are not completely verified, still this is a much more 
realistics situation. 

These images are gray levels images with pixels values in the interval [0,255]. The 
size of an image is 256 x 256 pixels. The correlated noise we consider is a Gaussian 
field {^k)k£i? built using an exponential covariance function 

\k\ 

C(k) = E(e ek) = Cst x exp{ }. 

a 

The choice of such random field ensures the validity of the projective criterion (p2) 
(see [8j, p. 59, Corollary 2). There exist several methods for simulating such a random 
field, here we have opted for the spectral method [H]. In order to obtain an important 
visual effect of how the noise affects the original image Cst was set to 200 and a = 1. 
The noisy image is obtained by adding pixel by pixel the original image to the simulated 
noise. The estimator of the original image is computed using the Epanechnikov kernel 

3 

K(x) = -(1 - |a;| 2 )I { | x .|< 1} , x = (x u x 2 ) e M 2 . 

o 

In order to compute the expectation of the estimated function, several realisation 
of the noisy image are needed. Here we have considered 50 such images, constructed 
by adding the original Lena image with a noise realisation. Using ([2]), for each noisy 
image, an estimate g n of the original function g was computed using the kernel K 
defined above. The expectation E(g n ) is computed by just taking the pixel by pixel 
arithmetical means corresponding to the images previously restored. 

Clearly, it is now possible to estimate the difference g n — E(g n ). Following our 
theoretical result, the normalised square of this difference follows a \ 2 distribution 
with one degree of freedom. Since this quantity is observable, p-values pixel by pixel 
can be computed. 

The obtained results for the synthetic and real image restoration are shown in 
Figure [Q and El respectively. In both situation, it can be noticed that in the "dirty" 
pictures, spots are formed, due to the noise correlation. The expectations of the esti- 
mated original images exhibit almost no such spots. Furthermore, the visual quality 
of the restored images is close to the originals. A more quantitative evaluation of this 
result is given by the image of p~ values of the proposed statistical test given in. The 
light-coloured pixels represent p- values close to 1, whereas the dark-coloured pixels in- 
dicate values close to 0. For the real image case, we have counted 83% of the pixels for 
which we have obtained a p-value higher than 0.01. This ratio is quite a reliable indi- 
cator concerning the restored image. Together with the visual analysis of the results, 
it provides a detailed description of the obtained result. We conclude that, under these 
considerations, the theoretical results developed in this paper may be used as a basis 
for the development of practical tools in image analysis. 
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Figure 1: Results of the image restoration procedure : a) original sinusoide image, 
b) realisation of a noisy image, c) expectation of the restored images, d) obtained 
p— values as a gray level image (white pixels represent values close to 1, whereas black 
pixels indicate values close to 0). 




Figure 2: Results of the image restoration procedure : a) original Lena image, b) 
realisation of a noisy image, c) expectation of the restored images, d) obtained p— values 
as a gray level image (white pixels represent values close to 1, whereas black pixels 
indicate values close to 0). 
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